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^ ABSTRACT 

o 

In this paper, we investigate the impact of survey strategy on the performance of 
O self-calibration when the goal is to produce accurate photometric catalogs from wide- 

field imaging surveys. This self-calibration technique utilizes multiple measurements of 
'^ sources at different focal-plane positions to constrain instruments' large-scale response 

I— —I (flat-field) from survey science data alone. We create an artificial sky of sources and 

^ synthetically observe it under four basic survey strategies, creating an end-to-end sim- 

ulation of an imaging survey for each. These catalog-level simulations include realistic 
measurement uncertainties and a complex focal-plane dependence of the instrument 
response. In the self-calibration step, we simultaneously fit for all the star fluxes and 
H the parameters of a position-dependent flat-field. For realism, we deliberately fit with a 

52 wrong noise model and a flat-field functional basis that does not include the model that 

'— ' generated the synthetic data. We demonstrate that with a favorable survey strategy, 

p\| a complex instrument response can be precisely self-calibrated. We show that return- 

^ ing the same sources to very different focal-plane positions is the key property of any 

l/^ survey strategy designed for accurate retrospective calibration of this type. The results 

Jy^ of this work suggest the following advice for those considering the design of large-scale 

imaging surveys: Do not use a regular, repeated tiling of the sky; instead return the 
(^ same sources to very different focal-plane positions. 
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• • Subject headings: Catalogs — methods: data analysis — techniques: photometric 

X 
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Cu 1. Introduction 

Astronomers tend to think conventionally in terms of taking science data and calibration data 
separately. The former is used for scientific measurements of astronomical sources and the latter is 
used to constrain instrument parameters, such as the instrument response, the dark currents and 
so-on. But typically far more photons, or readout electrons, are collected during science exposures 
themselves; are these not incredibly constraining on the calibration? Indeed, in the retrospective 
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photometric calibration of the Sloan Digital Sky Survey imaging data (SDSS), much more calibra- 
tion information was obtained from the science data than the calibration data ([Padmanabhan et al. 



2008). But, of course, the SDSS imaging strategy had to be adjusted to make this calibration work: 
good redundancy was required in the data stream, and a redundancy of a very specific kind. Self- 
calibration has been used to obtain the most precise photometric calibration of the PanSTARRS 



imaging data (Schlafly et al. 2012) 



In this paper, we argue that the next generation of large-scale imaging surveys should have 
their observation strategies designed from the very start with this kind of "self-calibration" in 
mind. This work focuses on the relative photometric calibration of a typical imaging instrument 
only, although similar techniques could be used to constrain many other calibration parameters, 
such as the optical distortion, point-spread-functions and so-on. The self-calibration technique 
utilizes the multiple measurements of sources in the survey arising from overlapping pointings. If 
these redundant measurements are recorded at different focal-plane positions or at different times 
within the survey, it is possible to constrain the relative instrument response by requiring that 
the post-calibration measurements yield consistent flux values. Through end-to-end, catalog-level 
survey simulations, we aim to identify the important properties of survey strategies that makes 
them advantageous for this kind of self-calibration. 

We construct realistic survey catalogs through mock observations of a synthetic sky according 
to a specified survey strategy. These simulations include a complex, position-dependent instrument 
response for the imaging instrument. Through the self-calibration procedure, we recover this in- 
strument response by fitting a model that best describes the survey catalog. By comparing the 
fitted instrument response to the true instrument response we are able to assess the performance 
of the self-calibration procedure with different survey strategies. 

In this work we do not produce pixelated images. Instead we create catalog-level simulations 
with realistic measurement uncertainties, including unmodeled source variability. Complex effects 
are included in the simulations that are (deliberately) not correctly modeled at the analysis stage, 
in order to simulate the effects of unknown systematic errors within the catalog. 

In Section [2] we introduce the simulation chain constructed to produce the realistic survey 
catalogs. Section [3] goes onto to detail the self-calibration procedure, with Section [4] summarizing 
the metrics we use to assess its performance. In Section [5] we focus on four simple survey strate- 
gies, which allow us to draw conclusions on the performance of the self-calibration procedure with 
different survey properties. 



2. Survey Catalog Simulations 

We have constructed an end-to-end simulation chain that produces a realistic imaging catalog 
from a specified survey strategjQ In this work we have kept the simulation parameters intentionally 
flexible, so that the sensitivity of the self-calibration procedure to different values can be investigated 
(the fiducial values are given in Table [I]). The simulations are split into a number of steps. The first 
is the generation of a synthetic sky. With a given pointing, single mock observations are performed 
on this sky. To build up a full-survey catalog, multiple single observations are performed according 
to the specified survey strategy. In this section, we detail the assumptions and methods used in 
each of these steps. 



2.1. Synthetic Sky 

We generate a representative synthetic sky based on realistic object densities in the AB mag- 
nitude range mmin = 17 to mmax = 22 magAB; with these limits chosen to be consistent with the 
saturation and a lOo" limits of deep, space-based, near-infrared, imaging survey. Sources are gen- 
erated with random coordinates (uniformly distributed within the sky region being investigated) 
and with random magnitudes m distributed according to 

^°Sioi — j^ = a + b'm + cm 
dmdil 

dN 

where -— is the density of sources N per unit magnitude m and per unit solid angle il, and a, 

dmdil 
b and c are model parameters. Even though our simulations make no distinction between galaxies 

and stars, the values of the parameters are found from fitting the Y-band galaxy populations 



reported in Windhorst et al. (2011) only. These parameters were found to be a = —13.05, b = 1.25 
and c = —0.02. The source magnitudes m are related to the source fluxes s simply by: m = 
22.5 — 2.5 logio(^); where the 22.5 puts the fluxes in units of nanomaggies (nmgy). To limit the data, 
we only select the brightest sources within the survey area, up to a source density d = 300 deg^^, 
for the self-calibration procedure. 



2.2. A Single Exposure 

With a telescope pointing (a, (3) and camera orientation 9, we find the focal-plane positions of 
the sources on the synthetic sky that fall within the instrument's field-of-view. In our simulations, 
we use a large instrument field-of-view of 0.75 deg x 0.75 deg; a size consistent with current large 
survey imagers. An example of a single pointing exposure is shown in Figure [T} 



^All code used in this work is publicly available at 



http : //github . com/davidwhogg/Self Calibration/ 



2.2.1. Measured Count Rates 

To generate photometric catalogs, the true source fluxes Strue are converted into measured count 
rates c with an complex, position-dependent instrument response model /true and a measurement 
noise model. For a measurement i, the count rate q recorded from a source k depends on the true 
instrument response /truel^TjIgtme) — which is a function of focal-plane position Xi — and the source's 

true flux Sfc,tme , 



where ^rue are the parameters defining the true instrument response (see Section 2.2.3), and Cj is 
a noise contribution drawn from the Normal Distribution A^(e|0, (Ttme^)- 



2.2.2. Noise Model 

To construct the noise model, the simulated exposures are assumed to be background limited 
and that, for systematic reasons, there is an upper limit on the signal-to- noise ratio of 500 for bright 
sources. The noise model is complicated further by applying an extra term ej to the count rates' 
uncertainty variance, which we intentionally do not take into account in the analysis in order to 
simulate systematic problems with the instrument noise model. The true noise model is therefore 

(^Ltrne = (1 + Cj) (^^ + r/^ [/tme(^ilfcue) Sfc,tme]^ , (1) 

where 5 and 77 are both constants and ej is a random number, drawn uniformly in the range 
[0.0, €max), generated for each measurement i. The m = 22 mag lOo" detection limit introduced 
previously and the limit S/N< 500 are used to set 6 = 0.1585 and r] = 0.0017. The e^ contribution 
is not taken into account in the analysis and therefore the uncertainty variances on the count rates 
are assumed (incorrectly, but realistically) to be 



2 s:2 , 2 2 



during this stage. 



2.2.3. True Instrument Response Model 

We construct a complex, position independent instrument response model ftrue{xi\qtruc) from 
a superposition of large- and small-scale variations: 

ftrue{Xi\qtrue,1...26o) = /large (2rj|gtruc,1...6) + /small(2^|9true,7...26o) ; 

where Xi = {xi,yi) is the focal-plane position that the fcth source falls at during the ith measurement 
and ^rue are the parameters defining the instrument response model. This response model subsumes 



various effects commonly discussed in terms of detector flat-fielding and optical vignetting. The 
large-scale instrument response /iarge(3ri|gtrue,i...6) is modeled as a second order polynomial: 

f\sivge{x'i\qtrue,1...6) = Qtrue.l + Qtrue,2 Xi + gtrue,3 Vi + '?true,4 X^ + (7tme,5 Xi yi + (?true,6 Ui 

The small-scale instrument response, which is constructed from sine and cosine contributions, 
is superimposed on this large-scale instrument response. The small-scale instrument response 
/smaii(^i|*;mo,7...26o) IS modeled as 

6 a 

fsma.ll{xi\qtrue,7...2m) = X] X^ (1 + « + ^)~°'^^ tetme,7+46 COs(A;a; Xi) + gtrue,8+4fe Sm(kx Xi)] 

a=0 b=0 

X [9true,9+46 COs(A;j, yi) + qtrue,10+ib sm{ky yi)] , 
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with the physical focal-plane dimensions X and Y. The (l+a+d)^^'"^^ factor reduces the magnitude 
of the higher order terms. In total, the instrument response model is parameterized with 260 
parameters; an example can be seen in Figure [T] (right). It is this instrument response that we 
try and recover with the self-calibration procedure. With this instrument response model, we have 
assumed that the variations in sensitivities on a pixel-to-pixel-scale have been calibrated with some 
other method, such as an internal flat-field calibration source. It is only the variations on larger 
scales that we aim to constrain with the self-calibration procedure. Our final assumption in these 
simulations is that the instrument response is temporally stable. 



2.3. Complete Survey 

In this work we are interested in simulating complete surveys, in order to identify the crucial 
characteristics of survey strategies that allow for the relative instrument response model to be 
accurately, retrospectively constrained from the resulting catalog. We therefore apply the single 
exposure procedure introduced in the previous section for each pointing specified in a defined survey 
strategy, which is a set of pointings (a, /3) and orientations (6). The resultant source measurements 
are collated into a survey- wide catalog. 



3. Self-Calibrating the Survey- Wide Catalog 

We self-calibrate the catalog generated in the survey simulations to recover an optimum es- 
timate of the true instrument response applied and the true source fluxes. This self-calibration 



procedure has been successfully applied to ground-based imaging surveys, such as the Sloan Digital 



Sky Survey ( Padmanabhan et al. 2008), where the procedure is dubbed "uber-calibration" , and 



the Deep Lens Survey (Wittman et al. 2011). This iterative procedure comprises two steps: (1) a 
refinement of the source flux estimates based on the latest instrument response model and (2) a 
refinement of the instrument response model based on the updated source flux estimates. These 
steps are iterated until the system converges, or until it is clear that the system will not converge. 
There is a degeneracy in the problem, as both the true instrument response and the true source 
magnitudes are unknown. It is therefore only possible to calibrate the relative instrument response 
and the relative source fluxes. It is not possible to know, for example, if the sources are all fainter 
or if the instrument response is uniformly lower. In practice, this degeneracy can be broken through 
observations of a small number of standard absolute sources. 



3.1. Fitting the Instrument Response Model 

To introduce a realistic level of ignorance into the simulations, we use the self-calibration 
procedure to flt a model that is incomplete in two ways. Firstly, the fitted instrument response is 
modeled as an eighth order polynomial, and not the second order polynomial superimposed with 
sine and cosine contributions used to model the true instrument response. Secondly, the assumed 
measurement uncertainty variances do not include the additional random measurement error ej 



introduced in Subsection 2.2.2 We therefore fit for the following, incomplete measurement model: 

Ci = fixl]q)Sk + ei , 

where Cj is the recorded count rate, f{xi\q) is the fitted instrument response model at a focal-plane 
position Xi, q'ls a vector parameterizing the eighth order polynomial instrument response model, Sk 
is the model source flux estimate and the error Cj is drawn from the Normal Distribution A^(e|0, Uj^), 
such that 
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where 5 and rj are the parameters set by the instrument's 10a detection and the S/N < 500 limits. 
The Ej error contribution is intentionally not included in order to simulate systematic problems 
with the instrument noise model. 

We make one further assumption during this analysis phase, namely that clearly variable 
sources have been removed from the source catalog, and that the remaining sources vary by less 
than emax- 



3.2. Step 1: Source Flux Refinement 

The sources are considered individually in the flrst step of the self-calibration procedure; their 
flux estimates are refined based on the latest fitted instrument response parameters q. An error 



function xi ^o^ ^^^ ^^^ measurements i of a source k {i ^ ^{k)) is constructed: 
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where q are the measured count rates, f{xi\q) is the fitted instrument response model at a focal- 
plane position Xi and ai is the assumed noise model. A new estimate of the model source flux s^ 
is then found by minimizing the error function with respect to the old model source flux s^: 
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The standard uncertainty variance on the new source flux estimate s'^ is given by 

fi{xi\q}^ 
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3.3. Step 2: Instrument Response Refinement 

The instrument response parameters can now be refined with the latest source flux estimates. 
A error function for all the measurements of all the sources is constructed 

2 _ V^ /2 

X / _, Xk 1 



where 
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Recall that the fitted instrument response fi{xi\q) is modeled as an eighth order polynomial. This 
can be expressed as 



fi{x,i\q) = ^Ql9l( 
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where L = 45 in this case. The total error function x^ can be rewritten as 
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To refine the instrument response model fit, this error function is minimized with respect to the 
instrument response model parameters qi 

dqi ^ ^ (,'2 
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It is now simpler to proceed in matrix notation. The following substitutions can be made 

9l{xi)s'f^Ci 



k i£0{k) * 

g/2 

^«' = mi -^9i{xi)gv{xi) . (3) 

k iaOik) * 

The matrix equation is then 

h = G-q' . 

The refined instrument response parameters are then found by 

q'^G'^-h . 

These two steps are iterated until the solution converges to a final fit of the instrument response 
f&tixlqit) and the source fiuxes Skfit, or until it is clear that a solution will not be found. 

It is worthy of note that although this back-and- forth (Step 1, Step 2) iteration scheme works 
well and is easy to understand, there is no reason in principle not to simply put the whole system 
into a non-linear optimizer. A sufficiently clever general-purpose optimizer might outperform these 
bilinear iterations. At the scale of the simulations and optimizations performed in this paper, there 
is no need to look for higher performance algorithms than the bilinear iterative solution presented 
here. 



4. Performance Metrics 

To assess the performance of the self-calibration procedure with different survey strategies, it is 
necessary to quantify the quality of the final fitted solution. To do this we defined three quantities. 
The first is the root-mean-squared (RMS) error S'rms in the final fitted source fiuxes Skfit compared 
to the true source fluxes Sk^true for the K sources used in the self-calibration procedure: 



S' 



RMS 



1 ^ / _ \2 



\ ^ I. ^ "5A;,truc 



In detail, we compute this S'rms excluding sources near the survey boundary. The other two 
metrics, called "badnesses", are defined as the error between the final fitted instrument response 
and a reference instrument response sampled on a regular 300 x 300 grid across the focal plane. 
For the "true badness" -Btrue, the fitted instrument response f{it{x\qit) is compared to the true 
instrument response ftTueix\qtr'ue) at the J sample points 
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The "best-in-basis badness" -Bbcst compares the fitted instrument response ffit{x'j\Qm) to the best 
instrument response fit possible fhcstixjlq^^st) with the basis used to describe the fitted model (in 
this case an eight order polynomial) at the J sample points 
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The best-in-basis badness is always smaller than the true badness, as it does not include the errors 
associated with the limitation of the basis used for the fitted model. The badnesses provide a more 
complete description of the self-calibration performance than the RMS error on the fitted sources' 
fluxes, as the RMS source error only applies to the bright sources within the survey selected for 
the self-calibration procedure. 



5. Simple Survey Strategies 

In this paper, we consider four simple but very different survey strategies. We use the end- 
to-end catalog simulation and self-calibration chain, introduced in Sections [2] and |3} to evaluate 
the performance of the self-calibration procedure with these strategies. The parameters of these 
simulations are summarized in Table [TJ 



5.1. Survey Description 

We label the four survey strategies — which all cover the same 64 deg^ patch of sky — with the 
letters A to D. These survey strategies are summarized in Table [2] and are shown in Figure [2j 
Strategy A is the simplest strategy; the target field is regularly tiled with small overlaps between 
adjacent pointings (~ 12 percent in both of the camera pointing directions). The pointings in the 
9 passes over the same field are exactly aligned. Survey B is the same as A, but with each pass 
over the target field the orientation of the telescope is rotated by 40°. 

Survey C is more complex. The first pass over the field is the same as in Survey A, with 12 x 12 
pointings. In the next pass, one of the pointings in the a direction is removed and one is added in 
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the /3 and the pointings are respaced uniformly, so the resultant pointing grid is 13 x 11. In the 
third pass over the field this change is reversed and the field is measured on a 11 x 13 grid. These 
three passes are then repeated three times. 

The pointing positions in Survey D are quasi-random: the pointings are the same as with 
Survey A, but each has a random offset within [-0.375,0.375] deg applied in both the a and /3 
directions. By fixing the pointings within these 0.75 deg x 0.75 deg boxes, we ensure that the quasi 
random strategy has a uniform coverage of the field; that is, the fluctuations in coverage are less 
than they would be in a Poisson (totally random) process. The orientations of the pointings in 
Survey D are completely random. 

Surveys A and C can be executed without rotating the camera with respect to the celestial 
coordinates. Surveys B and D can only be executed with systems that permit rotations of the 
camera. 



5.2. Self-Calibration Performance 

The iterative self-calibration procedure converges to a final fitted solution for the Survey B, 
C and D catalogs. With the Survey A catalog it does not converge in any reasonable time period, 
even when the system is started close to the optimum fit. The fitted instrument response solutions 
from the Surveys A to D catalogs are shown in Figures [3] to [6j In these plots the final fitted 
instrument response /fit(aJjlQfit) is compared to the true instrument response /truo(2^|'7tmc) and to 
the best possible instrument response fit with the basis used /bestCa^Jkbest) ("best-in-basis"). The 
accuracy of the final fitted solutions are summarized, with the metrics introduced in Section [4j for 
each of the Survey strategies in Table [3} 

The survey strategies, the resultant sky coverages and the errors in final self-calibration flux 
solutions are summarized for each survey individually in Figures [7] to 10 With Surveys A and B — 



and to a lesser extent Survey C — the imprint of the strategies can be clearly seen in the coverage 
maps. It is important to note that — with sufficient re- visits to the field — the coverage of the quasi- 
random survey D is more uniform than the other strategies investigated. 

The self-calibration procedure performs best with the Survey C and Survey D catalogs. The 
performance of the self-calibration procedure is worse for the Survey B catalog and it fails completely 
with the Survey A catalog, where no solution was obtained. The number of iterations of the self- 
calibration procedure required to converge to the final solution also decreases as the quality of the 
final fit increases: Survey D required 11 iterations. Survey C 24, Survey B 1,114 and the procedure 
was iterated 5,000 times with Survey A without reaching a solution. 

With the Survey C and D catalogs, the instrument response is accurately recovered. As can 
be seen from Figures [s] and [g] (top) , the fitted instrument response f'at{xj\q^x) does not perfectly 
reproduce the true instrument response /true(a^|9true)- That said, through comparisons with the best 
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fit possible with the eight order polynomial basis used in the self-calibration procedure fhestix'jlqhest) 
(bottom), we find that majority of the remaining errors in our fits are due to limitations in the 
model basis used. The residuals in this comparison are low; this can also be clearly seen in the 
significant improvement in the best-in-basis badness -Bbest compared to the true badness -Btrue- 
The results from these two survey catalogs are clear: if the correct redundancy is built into the 
survey, then self-calibration calibration can be used to accurately constrain the relative instrument 
response, with presumably the majority of the remaining errors coming from the limitations in the 
model used to represent the instrument response. 

Surveys C and D perform comparably well, although they are very different in their configu- 
ration. Two substantial advantages of Survey C over Survey D are: In Survey C the camera would 
not need to be rotated relative to the sky between pointings; indeed many survey imaging cameras 
have fixed celestial orientations. Survey D requires generating quasi-random numbers, whereas 
Survey C has a completely deterministic set of pointing centers. This is a conceptual advantage to 
Survey C, but possibly also an operational advantage. 

The Survey A and B catalogs also give interesting results. With Survey A, the self-calibration 
procedure did not reach a solution. This — in itself — is an important result, as the naive tiling of 
the sky currently being considered for many large surveys will result in catalogs that cannot be 
retrospectively self-calibrated. Minor changes to survey strategies, such as those in Survey C, can 
drastically improve the performance of the self-calibration procedure. Without these changes, vast 
amounts of calibration information is simply lost. We can also draw conclusions from the results 
obtained with Survey B: here the self-calibration procedure converges close to the correct solutions, 
albeit not as close as the Surveys C and D. Here, it is the quality of the fit over the focal plane that 
is interesting. From the residual plot against the best-in-basis instrument response fhestixj\qh^st) 
(FigureEH), we can see that the quality of the fit is rotationally symmetric, with the self-calibration 
procedure able to fit the instrument response well at the edge of the focal plane, but poorly at the 
center. As a result, the fluxes of the sources that fall at the center of the focal plane during a 
measurement cannot be constrained as well as those that fall at the edges; this can clearly be seen 
in the post-self-calibration flux error map shown in Figure [8]i. 

This, along with the success of the procedure with the Surveys C and D catalogs, gives an 
insight into the key property of a survey that makes it good for self-calibration. Namely, the 
survey should return the same sources to many, very different focal-plane positions. This allows 
the self-calibration procedure to link the different parts of the focal plane with each other through 
the observations of the same sources. Surveys C and D do this, and the self-calibration procedure 
performs well with their catalogs. Survey A does not do this; it only connects the outer edges of the 
focal plane to each other. There are no redundant measurements connecting the majority of the 
focal plane to other positions. This conclusion in confirmed with Strategy B. Here, positions at the 
outside of the focal plane are well connected to other positions, and therefore the self-calibration 
procedure can well fit the instrument response in these regions. In the center of the focal plane, 
on which the same sources always fall, there are insufficient redundant measurements to allow for 
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a good fit. Returning the same sources to very different focal-plane positions is critical for the 
self-calibration to work effectively. 



6. Discussion 

From the simulations presented in this paper, we are able to draw two firm conclusions about 
the self-calibration of large-scale imaging surveys. The first is that, in agreement with previous 
work, we show that this technique is very powerful, allowing the large-scale, relative instrument 
response of an imaging instrument to be accurately retrospectively constrained from the science 
images alone. The second is that there must be the correct redundancy built into the survey 
strategy. The same sources must be imaged at very different focal-plane positions; regular tiling of 
the sky is useless for this kind of calibration. 

As this work was completed in the context of space-based imaging surveys, we have not consid- 
ered the temporal variation of the relative instrument response as a high priority. We concede that 
this will have a significant impact on ground-based surveys, where variations on nightly timescales 
can be expected. The self-calibration procedure discussed in this paper can be trivially modified 
to fit for a time evolving relative instrument response model. For this to be effective though, it will 
be necessary to not only observe the same sources at very different focal-plane positions, but also 
to observe them at very different times within the survey. 

In this paper, we have considered the design of survey strategies for calibrating the large-scale, 
relative photometric response of an instrument, but there are many more calibration parameters 
that can be constrained from this method. For example, the optical distortion of an instrument 
or the point-spread-function variation could also be constrained with such a method, although it 
would need to be explored whether the properties of a survey strategy that makes it good for one 
calibration, are also suitable for other calibration aspects. 

Ultimately, survey design requires trade-offs between calibration requirements and other re- 
quirements related to cadence, telescope overheads, and observing constraints (like alt, az, airmass, 
and field-rotation constraints). One requirement that is often over-emphasized, however, is con- 
ceptual or apparent "uniformity"; these different survey strategies have different uniformities of 
coverage, each with possibly non-obvious consequences. Many astronomers will see survey strategy 
A as being "more uniform" in its coverage (especially relative to strategy D). This is not true, if 
uniformity is defined by the variance or skewness or any other simple statistic in exposure times; 
strategy D is extremely uniform (more uniform than Poisson, for example). In any survey, past 
and future, variations in exposure time have been valuable for checking systematic and random 
errors, and don't — in themselves — make it difficult to obtain a uniform survey in properties like 
brightness (since samples can be cut on any well-measured property). In general, in the presence 
of real astronomical variations in distributions of luminosity, distance, metallicity, and (more im- 
portantly) extinction by dust, there is no way to make a survey uniformly sensitive to the objects 
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of interest. As a community we should be prepared to adjust our analysis for the non- uniformity of 
the survey rather than adjust (cut) our data to match the uniformity of unrealistically simplified 
analyses. This is already standard practice in the precise cosmological measurement experiments, 
and will be required practice for the next generation of massively-multiple-epoch imaging surveys. 
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The code used in this work is publicly available at github . com/davidwhogg/Self Calibration/ 
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Fig. 1. — A single exposure of the synthetic sky. Left: A plot of the bright sources within the 
synthetic sky used in the self-calibration procedure, with the focal-plane footprint overlaid. Right: 
The resultant distribution of the sources on the instrument's focal plane. The true instrument 
model ftTue{xi\qtrue) is shown with contours. 
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Table 1. A summary of the tunable parameters in the simulations and their fiducial values. 



Parameter 



Fiducial Value 



Source Density - Eqn. 1 (deg~^) 

Survey Area (deg^) 

Source Density (deg^^) 

Saturation Limit (mag) 

lOcT Detection Limit (mag) 

Field-of-View (deg^) 

Noise Model - Eqn. fl] 

Fitted Instrument Response Model 



= -13.05,6 = 1.25, c= -0.02 

8x8 
d = 300 

'^min — ^ ' 
'^max — ^-^ 

0.75 X 0.75 
0.1585, 7] = 0.0017, einax = 1-0 
gth order polynomial 
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Fig. 2. — Focal-plane footprints projected onto the synthetic sky according to the four simple 
survey strategies described in Section [5] and summarized in Table [2j Surveys A, B and D have 1296 
pointings and survey C has 1290 pointings. 
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Fig. 3. — Survey Strategy A: A comparison of the fitted instrument response model /fitCa^jI'Zfit) 
(black) obtained from self-calibrating the Survey A catalog compared to (a) the true ftrue{x\qt7uc) 
and (c) the best-in-basis /bcst(2^kbcst) instrument response models (gray). The self-calibration 
procedure did not converged to the final solution and the results presented here correspond to the 
instrument response found after 5,000 iterations. The best-in-basis instrument response is the best 
fit to the true instrument response possible with the basis used to model the instrument response 
in the self-calibration procedure (in this case an eighth order polynomial). The plots (b) and (d) 
show the residuals between the two instrument response models plotted in (a) and (c) respectively. 
With this survey strategy, the center of the focal plane is never connected to other parts with repeat 
observations of the same sources. 
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Fig. 4. — Survey Strategy B: A comparison of the fitted instrument response model /fit(a!^|<?fit) 
(black) obtained from self-calibrating the Survey B catalog compared to (a) the true /true(a^ktruc) 
and (c) the best-in-basis /bcstl^J^kbcst) instrument response models (gray). The self-calibration 
procedure converged to the final solution after 1,114 iterations. The plots (b) and (d) show the 
residuals between the two instrument response models plotted in (a) and (c) respectively. With this 
survey strategy, it is only regions towards the edge of the focal plane that are well interconnected 
with repeat observations of the same sources, and therefore the self-calibration procedure can only 
fit a reasonable instrument response model at these positions. 
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Fig. 5. — Survey Strategy C: A comparison of the fitted instrument response model fmixjlqit) 
(black) obtained from self-calibrating the Survey C catalog compared to (a) the true /truc(a?ktruc) 
and (c) the best-in-basis /best(a^kbcst) instrument response models (gray). The self-calibration 
procedure converged to the final solution after 24 iterations. The plots (b) and (d) show the 
residuals between the two instrument response models plotted in (a) and (c) respectively. With 
this regular observing strategies, all regions of the focal plane well interconnected with each other. 
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Fig. 6. — Survey Strategy D: A comparison of the fitted instrument response model /fit(a!^|<?fit) 
(black) obtained from self-calibrating the Survey D catalog compared to (a) the true ftrue{x\qt7ue) 
and (b) the best-in-basis fhestixj\qh^st) instrument response models (gray). The self-calibration 
procedure converged to the final solution after 11 iterations. The plots (b) and (d) show the 
residuals between the two instrument response models plotted in (a) and (c) respectively. With 
this quasi-random observing strategies, all regions of the focal plane well interconnected with each 
other. 



22 



Sky Pbsition (i tdeg) 

2 4-4-2 





nmmmmmfmrnmrnm 




m 2[) 30 40 aO 

Number of Observations 



-4 -2 D 2 4 

Sky Position a (deg) 



11) ^ 



- II 



o 
-1 ^ 

(in 



Fig. 7. — A summary of Survey Strategy A and the self-calibration results: (a) shows the survey 
footprint diagram (as shown in Figure ^1), (b) shows the source coverage for this survey, with (c) 
showing a histogram of the number of source observations (excluding sources very near the survey 
boundary) and (d) shows the flux errors for each of the sources after the self-calibration procedure. 
In panels (b) and (d) the white gaps are not gaps in the survey coverage but rather sky positions at 
which there do not happen to be observed stars. The imprint of the survey strategy can be clearly 
seen in the coverage map. With this survey strategy, the self-calibration procedure is not able to 
converge to a solution and therefore there are strong and regular residuals in the flux error map. 
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Fig. 8. — A summary of Survey Strategy B and the self-calibration results: (a) shows the survey 
footprint diagram (as shown in Figure ^1), (b) shows the source coverage for this survey, with (c) 
showing a histogram of the number of source observations (excluding sources very near the survey 
boundary) and (d) shows the flux errors for each of the sources after the self-calibration procedure. 
In panels (b) and (d) the white gaps are not gaps in the survey coverage but rather sky positions 
at which there do not happen to be observed stars. The imprint of the survey strategy can be 
clearly seen in the coverage map. With this survey strategy, the self-calibration procedure can well 
calibrate the instrument response at the edge of the focal plane, but not in the center. As a result, 
the residuals in the flux error map are higher at the center of each pointing, where the sources fall 
on a less well constrained part of the focal plane. 
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Fig. 9. — A summary of Survey Strategy C and the self-calibration results: (a) shows the survey 
footprint diagram (as shown in Figure [2]), (b) shows the source coverage for this survey, with (c) 
showing a histogram of the number of source observations (excluding sources very near the survey 
boundary) and (d) shows the flux errors for each of the sources after the self-calibration procedure. 
In panels (b) and (d) the white gaps are not gaps in the survey coverage but rather sky positions 
at which there do not happen to be observed stars. 
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Fig. 10. — A summary of Survey Strategy D and the self-calibration results: (a) shows the survey 
footprint diagram (as shown in Figure ^1), (b) shows the source coverage for this survey, with (c) 
showing a histogram of the number of source observations (excluding sources very near the survey 
boundary) and (d) shows the flux errors for each of the sources after the self-calibration procedure. 
In panels (b) and (d) the white gaps are not gaps in the survey coverage but rather sky positions 
at which there do not happen to be observed stars. As can be seen in panel (c), this quasi-random 
survey offers a more uniform coverage of the field than the other surveys; it also has much more 
uniformity than would a Poisson distribution of field centers. 
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